課程資訊
課程名稱
消息理論
Information Theory 
開課學期
104-1 
授課對象
電機資訊學院  電信工程學研究所  
授課教師
王奕翔 
課號
EE5028 
課程識別碼
921EU1190 
班次
 
學分
全/半年
半年 
必/選修
選修 
上課時間
星期二6(13:20~14:10)星期三3,4(10:20~12:10) 
上課地點
電二225電二225 
備註
本課程以英語授課。
總人數上限:40人 
課程網頁
http://homepage.ntu.edu.tw/~ihwang/Teaching/Fa15/IT.html 
課程簡介影片
 
核心能力關聯
本課程尚未建立核心能力關連
課程大綱
為確保您我的權利,請尊重智慧財產權及不得非法影印
課程概述

Information Theory is a senior (undergraduate) level course designed for students who are interested in the quantitative fundamental limits of information. What is information and how to quantify information? What is the ultimate data compression rate and what is the ultimate transmission rate of communication? In this course, we introduce the fascinating theory originated from Claude E. Shannon, which addresses the above fundamental questions in communication theory. We will develop methods and coding techniques to achieve these fundamental limits. Finally, we will also demonstrate the application of information theory to other fields, including statistics (hypothesis testing and estimation) and statistical inferences.  

課程目標
1. Introduce basic topics in information theory, including measures of information, source coding theorem, channel coding theorem, and source-channel separation.
2. Develop methods and coding techniques to achieve these fundamental limits.
3. Show applications of information theory beyond communications.  
課程要求
Prerequisite: Probability, Linear Algebra
Grading: Homework (30%), Midterm (30%), Final (40%)  
預期每週課後學習時數
 
Office Hours
 
指定閱讀
Lectures will be based on lecture notes and slides. Further information about assigned readings will be provided in the first lecture.  
參考書目
1. T. Cover and J. Thomas, Elements of Information Theory, Second Edition, Wiley-Interscience, 2006.
2. R. Gallager, Information Theory and Reliable Communications, Wiley, 1968.
3. I. Csiszar and J. Korner, Information Theory: Coding Theorems for Discrete Memoryless Systems, Second Edition, Cambridge University Press, 2011.  
評量方式
(僅供參考)
   
課程進度
週次
日期
單元主題